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Abstract 

In this paper we introduce a capacity allocation game which models the prob- 
lem of maximizing network utility from the perspective of distributed noncoop- 
erative agents. Motivated by the idea of self-managed networks, in the developed 
framework the decision-making entities are associated with individual transmis- 
sion links, deciding on the way they split capacity among concurrent flows. An 
efficient algorithm is given for computing a strongly Pareto-optimal strategy, 
constituting a pure Nash equilibrium. Subsequently, we discuss the properties of 
the introduced game related to the Price of Anarchy and Price of Stability. The 
paper is concluded with an experimental study. 
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1 Introduction 

Modern communication networks provide universal systems of data exchange within di- 
versified services and applications. Publicly available communication channels, main- 
tained by Internet service providers (ISPs), are shared by very large numbers of con- 
current packet flows. Each of such data transmission usually corresponds to the com- 
^ munication between a client application (invoked by a user) and a server application. 

On the global scale, users can be seen acting independently and willing to selfishly 
maximize their utility, reflected in their transmission speed or response delay. One 
distinctive characteristic of such systems is the lack of central coordination or regula- 
tion. 

In the presence of limited communication resources, packet transfer protocols need 
to incorporate congestion avoidance functionalities. It has been shown (3l] what kind 
of users' utility can be maximized with the use of Internet transmission control protocol 
(TCP) |25|. Many challenging questions arise when one seeks to design a communica- 
tion network in such a way so as to optimize a given utility measure. In the last years, 
this line of research has stimulated many advancements in the area of distributed 
mathematical optimization (7J. Some of the most interesting results were obtained 
with the use of algorithmic game theory, which has become a method of choice for 
analyzing properties of distributed protocols. 
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In this paper we employ this approach to the analysis of distributed transmis- 
sion rate control problem, formulated within the network utility maximization frame- 
work. In the majority of prior research on the network resource allocation games, 
usually users (clients or flow sources) were modeled as players. Motivated by the 
idea of self-managed (autonomic) networking, we propose an alternative formulation, 
in which players are associated only with transmission links (more specifically, ISP- 
owned routers' network interfaces). This approach makes our solution prone to the 
negative effects of users' selfishness, limiting their possibilities of abuse, and avoids the 
potential problems of individual players deviating from rational behavior. 

It was argued that the part of network maintenance cost corresponding to human 
administering/operating of the system is rapidly growing, and becomes negligible in 
comparison to the devices' prices. It is predicted that such trend will last in the coming 
years |1|. Therefore, it is crucial to develop mechanisms which enable managing the 
network resources in an automatic or semi-automatic manner. The aim of the proposed 
solution is to limit the human administrator role only to defining the goals of system's 
operation. It is assumed that network routers may be considered as autonomous 
entities, which operate independently. Only limited coordinating communication is 
allowed between them. 

The main contribution of this paper is an efficient distributed algorithm which 
provably stops at Pareto-optimal Nash equilibrium of link capacity allocation in the 
considered utility maximization problem. Unlike typical distributed methods of solving 
such network problems (e.g.: Lagrangian relaxation-based methods for finding saddle 
point, or direct interior-point method decentralization [14] ) our approach leads to fast 
procedure that gives a very good approximation of the optimal solution. Although 
finding optimal allocation is not guaranteed, computational experiments show that 
the proposed solution is very scalable, requiring only few iterations regardless of the 
number of considered links and flows. 

The paper is organized as follows. Section [2] gives an overview of the related work, 
including references to the game theoretical literature and studies on relevant network 
resource allocation problems. The problem statement is given in Section [3} Main 
results of the paper are contained in Section [4], including definition of the link capacity 
allocation game, two algorithms for computing strategies, and the proof of pure Nash 
equilibrium resulting from the strategy computed by the second algorithm. Section 
[5] discusses additional properties of the game, including the analysis of hypothetical 
strategy giving optimal allocation. Computational study is presented in Section [6} 
Finally, Section [7] concludes the paper. 



2 Related Work 

The idea of autonomic networking was introduced by IBM |33|. A similar concept 
underlies the self-organizing networks (SON) |53|. Recently, SON approach has been 
extensively studied for the application in 4G LTE mobile networks |24| . In |45j authors 
argue that some existing protocols like TCP or Open Shortest Path First (OSPF) may 
be treated as basic solutions for autonomic networking. 

The central network resource allocation problem is the network utility maximiza- 
tion problem (NUM), which is also discussed in this paper. As formulated in [32], it 
provides the basis for further considerations. An extensive survey of the utility-based 



approach applied to the analysis of network resource allocation can be found in 10 
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Moreover, in |30| it was shown that the NUM framework suits well for developing a 
self-managing mechanism for the Internet. 

A survey of the most important approaches in autonomic network management 
may be found in [13] and (TJ. However, it is worth noting that the most common con- 
cepts towards self-management are related to control theoretic approach [11], biological 
inspired mechanisms (3) and game theory 40 



Game theory is a very powerful framework for studying decision making problems, 
involving a group of agents acting individually, being rational and competing or coop- 
erating to achieve certain goals [46]. It provides mathematical tools for analyzing the 
consequences of agents' behavior and enables developing mechanisms, which encourage 
them to make expected actions. Game theory has been widely studied in the context 
of many different applications, mostly in economics, but also in politics, biology, phi- 



found in 16,49 



losophy and computer science 39 . An introductory material on game theory may be 



In the recent years a subfield known as algorithmic game theory has emerged 



37,50 , combining game theory and algorithms design. This was mainly motivated 
by the need for analysis of interaction of independent agents in the Internet, in such 
problems as inter-domain routing, peering, online auctions, online advertising, etc. 
The problems tackled with the use of algorithmic game theory include establishing the 
existence of Nash equilibria, computing the Price of Anarchy and Price of Stability, 
and designing computationally efficient procedures for determining players' strategies. 
Moreover, employing the mechanism design techniques allows for constructing and 
analyzing computational procedures executed by collections of machines (48). We 
refer to |47| as a comprehensive textbook on algorithmic game theory. 

Many interesting results in algorithmic game theory applied to computer networks 



have been obtained in the last ten years. In 39 two TCP clients are interpreted 
as players in the prisoner dilemma game. Another game-theoretical analysis of TCP 
is given in |6~0~] , focusing on the Vegas version of this protocol. In [27] it is shown 
that the noncooperative games for flow control problems have Pareto-inefficient Nash 
equilibria. 



In 59 the co-existence of different congestion avoidance protocols is considered. 
It is shown that some properties related to the NUM approach do not hold in the 
presence of heterogeneous congestion signals. Such a situation is explained through 
game theoretical framework. 

The important class of games concerning allocation problems in networks (not 
necessarily communication networks) are congestion games [55]. Typically congestion 
games are applied for routing problems in computer networks, where the sources (users) 
are interpreted as players deciding on the selection of paths to transmit data at a given 



rate (19,29 . The player's strategy consists in deciding how to split this rate among all 



possible paths from the source to the destination, or, if flows are unsplittable, which 



routes to use for transmission. In 1 34] and 35 the authors propose a methodology 
of architecting noncooperative games for network resource allocation problem, which 
may improve overall system performance during provisioning and operating phase of 
network lifecycle. The solution is obtained for a parallel link network structure. It is 
shown that for such a case, the occurrence of the Braess paradox [5] may be avoided. 
Some of these results are extended for a general network. In [26] the congestion game 
for the rate allocation problem is presented. The variant of a one-link network is 
analyzed, and it is shown that for such case, the Price of Anarchy is no greater than 
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4/3. Similarly, the extension for general networks is briefly discussed. 

Bottleneck congestion games are quite similar to congestion games, however the 
payoff function is different. Routing problems are also considered within this frame- 
work |23|. Although the Nash equilibria for such games usually exist, their performance 
(estimated via Price of Anarchy values) is usually poor. A game with a relatively low 
Price of Anarchy is proposed in |28|. In |4 two types of bottleneck games are con- 
sidered, for splittable and unsplittable flows. It is also shown that for both proposed 
games the Price of Anarchy is unbounded. However, it is proven that under some mild 
conditions the Nash equilibrium is socially optimal. 

Work (38) considers both congestion game and bottleneck congestion game, in the 
application to the routing problem. It also proposes a new routing game specifically 
for the elastic flows. All three approaches are compared. Basing on one example and 
two real network experiments, some advantages of the introduced game are shown. 

In 1 52 1 the approach to resource allocation for the networks with quality of service 
(QoS) based on Differentiated Services (6) architecture is proposed. The sources (flows) 
are players. They choose one QoS class and the transmission rate in this chosen class. 
The players' payoffs are proportional to the transmission rate if their QoS requirements 
are satisfied and zero otherwise. For the proposed noncooperative game, a simple 
algorithm computing Nash equilibrium is presented. The extension of this concept is 
given in |21|. 

The joint problem of QoS routing and capacity allocation problem is considered 
in [l7j. In the proposed game, two group of players are introduced, namely capacity 
players (each related to one link) and network users (each related to one pair of source 
and destination). Each capacity player divides its capacity among given Class of 
Services to minimize overall congestion over the associated link. On the other hand 
each user splits their traffic among all available paths so as to maximize a degree of 
satisfaction. 

In (62) the bandwidth allocation problem in the virtual networks (VN) (!~5) environ- 
ment is considered. The problem is presented in terms of the non-cooperative game 
between service providers (VNs' owners) seen as players. The strategy of a player 
is determined by virtual links' capacities and flow rates in the particular VN. The 
utility and cost functions constitute the payoffs. The constraints concerning limited 
amount of physical links' capacities (bandwidths) are substituted with a congestion 
cost which is one of the addends of the cost function. Authors prove the existence of 
Nash equilibrium for such a game. An iterative algorithm is proposed, converging to 
the equilibrium, based on the best response method. 

Furthermore, another type of games called auctions |42| seems very suitable for 
computer network applications (36). In (58) classic Vickerey- Clarke- Groves (VCG) 
mechanis m |4l) , together with the so-called Kelly mechanism (based on results ob- 
tained in |32|), is used for the network resource allocation. In [l2j the capacity alloca- 
tion problem is stated as an auction game between flows (users), seen as buyers, and 
network operator, seen as an auctioneer. A distributed algorithm to find efficient Nash 
equilibrium is proposed. The presented mechanism is described as VCG-like, since, on 
the contrary to the classic VCG auction, it does not require a full valuation function. 

Currently, the game-theoretical framework is also extensively studied in the context 
of wireless networks (18). For instance, in (57) bandwidth allocation problem for a class 
of wireless networks is investigated. The uniqueness of Nash equilibrium for some 
particular network topologies is shown. It is also stated that some of the presented 
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results may be also generalized for different cases. In (43) the problem of choosing 
an access point by a mobile user is considered from the perspective of this approach. 
Similar frameworks for issues in wireless networks categorized under corresponding 
OSI Layers (namely: physical, data link, network and transport layers) are presented 
in 19). The VCG auctions were also applied to the wireless networks, e.g. in |20] it is 
proposed for the resource allocation problem in multimedia wireless networks. 

In [56] coalitional games for a communication systems are considered. A classifi- 
cation of such games distinguishing three main types of cooperative games is given. 
It is stressed that the need of autonomic and self-organizing networks implies the 
necessity of developing distributed algorithms which enable each network device to 
make independent decision concerning network management. Application examples 
of cooperative games in computer networks, mainly wireless, are discussed. Presented 
arguments corroborate the game-theoretic approach as a promising solution for auto- 
nomic (and self-organizing) networks. 

More detailed surveys of game theoretical applications in various network resource 
allocation problems may be also found in [2~J[9]. 



3 Problem statement 

In the considered problem the network consists of a set of L links, each with capacity 
Ci > 0, I G {1, . . . , L}. Denote c = [c\, . . . , Cl] T ■ There are R flows (users' packet 
transmissions), defined by a routing matrix A = [aj r ], where a\ T = 1 if r-th flow 
traverses Zth link, and a\ r = otherwise. Each flow is characterized by the transmission 
rate x r > (expressed in bits per second). Denote x = [x\, . . . , Xr] t . For each 
flow there is an associated utility measure u r (x r ), which is assumed to be strictly 
increasing concave and twice-differentiable function of transmission rate (reflecting 
user's willingness to pay to their network operator). 



The network utility maximization problem (NUM) introduced in 32 is defined as 
follows: 

R 

maximize Q(x) = u r (x r ) (1) 

=i 



subject to: 



Ax < c, (2) 

x > 0. (3) 

In this paper we restrict the choice of utility functions to the so-called isoelastic 
functions, that is, to the class of functions^] 

/ \ / Wi^-x 1 -" 1 7 > 0,7 ^ 1, 

U r (x r ) = < 1 T (4) 

[ Wi logx r 7 = 1. 

It was shown that such class of functions leads to proportionally fair allocations of 
transmission rates (44), thus is typically employed in the analysis of network resource 
allocation problems. 

In practical instances of interest (especially on the scale of Internet autonomous 
systems or ISP networks), the number of concurrent flows is very large and there is no 



1 Symbol logx denotes the natural logarithm function. 
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central authority capable of managing all transmission rates simultaneously. Therefore 
we are interested in designing and analyzing decentralized protocols, which solve this 
problem (or approximates its solution) in a distributed manner. Such protocols are 
typically implemented as a part of low-level operating system's kernel software; in 
particular TCP/IP stack includes procedures for flow control and congestion avoidance, 
available in many implementation-dependent variants. Emerging networking solutions 
provide more advanced means of rate control, incorporating Quality of Service (QoS) 



capabilities 22 61 



In the following section we show how the interaction between concurrent decision- 
making agents can be modeled as a game. Subsequently we establish a relationship of 
the formulated game's outcome and the solution of the NUM problem. 



4 Algorithms for computing strategies 
4.1 Definition of the game 

We introduce the following network game. Each Zth link in the network is associated 
with one player. Players must decide on the way they allocate their total capacities 
q among the set of flows traversing their corresponding link. Each player makes a 
decision individually. The decision of Zth player, called player's strategy, is denoted 
s/ = [sn, S12, ■ ■ ■ , sm} T , where si r is the fraction of Zth link's capacity allocated for 
rth flow. We restrict the player's choice only to feasible decisions, that is, satisfying 
Y^ r =l a ir s ir < Q- However, the transmission rate of a single flow is limited by the min- 
imal allocation of some link along the path of that flow (defined by the routing matrix 
A). The player's payoff is computed as the value of weighted utility of transmission 
rates of all the flows passing through the corresponding link. The strategy of the game 
is defined as S = [si, . . . , sj. Formally, the Zth player's payoff is given by: 

R 



Ql(S) = '^2ai r b r U r I 



mm Skr 

where b r > is a weight assigned to the rth flow. 

The social welfare is defined as Q(S) = Y^/t=i Qi(S), that is the sum of all payoffs. 
The total utility of the network, given as the objective of problem ([I]), corresponds to 
the social welfare with weights: 

b r = ^rr , (5) 

Z^fc=l a kr 

that is, the reciprocal of length of the path associated with rth flow (this value is 
equal for all links). In this paper two types of game's payoff matrices are considered: 
one with the set of weights defined by ([5]), and one with uniform payoffs, that is, all 
weights b r = 1. 

In the following subsections we present two algorithms for computing certain fea- 
sible strategies. In both cases the computations can be carried out independently by 
all players, since the only constraints imposed on player strategies sj are local. This 
makes these algorithms suitable for implementation as decentralized protocols. Next, 
we show that the first algorithm, although simple to implement, does not guaran- 
tee establishing an equilibrium. However, the second one, which can be seen as its 
extension, allows to obtain a pure strategy strongly Pareto-optimal Nash equilibrium. 
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4.2 Local one-step allocation algorithm 



Consider the following algorithm. Each player solves a local concave optimization 
problem, given as: 



R 

Sf = arg max > ai r b r u r (si r ) (6) 
s,eD, 



=1 



where: 



r « 

\ r=l 

For the assumed class of utility functions Q, given fixed 7, the solution can be 
derived analytically, as: 



Sir — a lrCl 



(b r w r 



,1/7 



Ef=i%(^;) 1/7 ' 



This algorithm is a realization of the simplest rational strategy, which can be 
computed without any communication between players. Due to this fact, there are no 
synchronization issues concerning implementation in a networked environment. This 
approach resembles the "safe" algorithm for distributed optimization, given in [51] for 
solving positive linear programs. Moreover, the computational complexity is low, as 
constructing such solution boils down to solving concave maximization problem in n\ = 
\{r G R : ai r = 1}\ variables (in general, this can be accomplished in polynomial time 
with the use of interior-point methods |8j; for isoelastic utilities evaluating analytic 
solutions results in 0(n{) time complexity). 

However, as the following example shows, in general this algorithm does not pro- 
duce a state of equilibrium; a player may be better off changing its allocation without 
informing the other players. 

Example 1. Consider two links (L = 2), the first with capacity C\ = 10 and the 
second with capacity c 2 = 100. There are three flows (R = 3); first flow passes 
through both links, while the two other flows use single links, link 1 and link 2, 
respectively (see Figure [T]). All utility functions are assumed to be logarithmic, i.e. 
Ui(x) = u 2 (x) = u 3 (x) = \ogx. 

The local algorithm computes the following strategy vectors for both players (links), 



S 1 



4 = (5,5,0), 



= (50,0,50). 

The payoffs of players (i.e. the local utilities of their corresponding flows) are equal 
Qi(s[) = log 5 + log 5 and Q 2 {4) = log5 + log 50. 

If S 7 were a Nash equilibrium, no player would have an incentive to unilaterally 
deviate from this allocation. However, since the capacities in both links are uneven, 
a fair allocation is suboptimal. The high-speed link with c 2 = 100 should promote 
the flow 3, as it does not pass through the bottleneck link with c\ = 10. Thus the 
following change of player 2 strategy: 

s' 2 = (5,0,95) 

gives a better outcome, Q2{s' 2 ) = log 5 + log 95. 
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Figure 1: Illustration of a simple network setup in Example 1. 
4.3 Iterated allocation algorithm 

The algorithm presented in the previous section can be easily improved, if we allow 
players to interact in the following way. Initial allocations are computed with the use 
of the local one-step algorithm. After these allocations are computed, all sources start 
sending data and transmission rates of all flows gradually increase from zero. The rate 
of a flow stops accelerating as soon as some link on the path becomes a bottleneck, 
i.e. the rate reaches minimal allocation of some link along its path. This must be 
detected with the use of a congestion avoidance algorithm (e.g. as a part of TCP), 
which notifies the source that the capacity on the path has been exceeded. We call such 
flow saturated. This means that it is no longer possible to increase its rate. However, 
other links on the path of such flow may have unused capacity. Thus it is possible 
to assign this capacity among the non-saturated flows, increase their rates and repeat 
that until all the flows become saturated. 

This procedure is summarized as Algorithm [T] Step [T] requires executing lo- 
cal one-step algorithm (solving problem ([6])). In the presented pseudocode, = 



[s[ , . . . , s[ n ' ) ] T denotes the strategy vector computed in nth iteration. The final strat- 
egy vector returned by the algorithm is denoted S 11 . The following auxiliary notation 
is used in the algorithm's description. Denote IZi = {r : ai r = 1} the set of flows 
traversing link I. Set TZ n denotes all the flows that are not yet saturated in nth it- 
eration. Set C n denotes all the links that ran out of capacity in nth iteration. The 
smallest index of link that runs out of capacity in nth iteration is denoted 0(n). 

The implementation of the presented algorithm needs to be appropriately struc- 



tured in the networked environment. In particular, step 11 is executed concurrently 
by all links / G {1, . . . ,L} using local information, while step [6] can be seen as "co- 
ordinating" phase, in which saturated flows are detected and removed from further 
considerations (this is also achieved locally by each link, by detecting whether a flow 
stopped increasing its rate). 

The correctness of the Algorithm [T] follows from the following fact: 

Proposition 1. For isoelastic utility functions the set 
is nonempty for all i, such that IZi 7^ 0- 

Proof. The proof is by contradiction. Assume that at nth iteration of the Algorithm [T] 
there is no link with the capacity completely filled. Since the set lZ n ^ 0, this implies 
the existence of sequence of links, constructed as follows. In mith link there is a flow, 
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Algorithm 1 Iterated Allocation Algorithm 



n!<-{i,...,R} 

A <~ { l ■ Ef=i air (min fc:afer= i s^) = q} 
n <- 2 

while n < L do 

where: 



0(i) := min£ 

R 

I : r//,. | ami .s 



r=l 



Cl 



9 
10 
11 



if TZ n = then 

g/J ^ g(n) 

return S /J 
end if 

determine S^: 



where: 



= arg max ai r b r ui r (si r ) 



s/ : ^a /r s /r < q, V r < s tr < a /r s /r 



V 



(n-1) 



12: n <- n + 1 

13: end while 

14: S /J <- S< n > 

15: return S 7/ 
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which is saturated by link 777,2. In link m2 there must be some spare capacity, that is, 
there must be a flow, which is saturated by link 777.3. Continuing this reasoning, we 
conclude that there is some link m^, which must belong to the set {mi, 777,2, • • • , "fyc-i}, 
since there is only a finite number of links (otherwise must be completely filled, as 
no other link prevents the increase of its allocation). Without the loss of generality, 
let 777^ = mi, and = T\. 

Suppose link m\ saturates the flow r\, that is: 

Sm\r\ mm S/j ri Iri) 

and suppose flow r 2 , which also passes through link mi, is saturated by the link 7772. 
Similarly, link 7772 saturates the flow r 2 , and contains the flow r 3 , saturated in the link 
m 3 , etc. The last of the considered flows, r^-i, is saturated in the link m^-i, which 
contains the flow r\. 

The class of isoelastic functions Q has the property that optimal allocations are 
proportional to the weights v r = (6 r 7iv) 1//7 . Thus rth flow on Zth link gets the share of 
capacity q equal to v r . 

The allocations of flows 7*1 and r 2 in link m\ can be written as: 

fri Cm 1 



J2k:a^ h =l a mikVk 



and consequently: 



Since the flow r 2 is not saturated in link ra x , there exists a constant < a\ < 1, such 
that: 

Ob fry Gt\ Xy-. • 

Similarly, the allocation ratio of flows r 2 and r% in link 7772 can be written as: 



and there exists a constant < a 2 < 1, such that: 

_ V r-j _ Vr 3 

— Qt 2 *^t*2 — OL 2 OL\_ *^T\ ' 

Continuing this reasoning, we reach the link m^-i, in which the allocation ratio is: 

s m fe _ 1 ri V ri 



and consequently: 

'k-\ 

n 

Since the product of ctjS is less than 1, we get a contradiction. 

□ 
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Remark 1. Strategy S has the property that all link allocations along the path of 
any flow are equal to the minimum allocation for that flow, i.e.: 

V r V /:a;r= i sf/ = min 4r- 

k:a kr =l 

The algorithm executes no more than L outer iterations. Moreover, the strategy 
S 7/ computed by Algorithm [l] dominates the strategy computed by local one-step 
algorithm. 

In each iteration the algorithm completely fills the capacity of a subset of links. 
However, observe that in each iteration exactly one link (with the smallest index in such 
subset) is removed from the further consideration. Thus without the loss of generality, 
it is always possible to renumber the indices of links in such a way, that the order of 
removed links matches the iteration number, i.e.: <p{n) — n for all n = 1, . . . , L. 

Henceforth, we assume that the links have been renumbered this way, prior to the 
execution of the algorithm. 

a) » = 1 




SATURATED FTOW 



c) n = 2 




Figure 2: The idea of Algorithm [T] 

For the better understanding of the proposed iterated algorithm, let us consider 
the following example. 
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Example 2. Assume the same data as in Example 1 (including network structure, 
number of flows, routing matrix, links' capacities, utility functions) and the game with 
uniform payoff matrix. At the beginning of the execution of Algorithm [T] all flows are 
not saturated, TZi = {1,2,3}, so each link allocates capacities maximizing its own 
objective, and the players' strategies are the same as in Example 1, i.e.: 

Si 1} = (5,5,0), 
4 ] = (50,0,50), 

as it is depicted in Figure [2^. Once all strategies are computed, the sources may 
transmit data at rates: 

x= (5,5,50). 

It is clear that only first link becomes filled (£i = {1}), and the first and the second 
flows are saturated (which means that only the third one is not saturated, IZ2 = {3}) 
as it is shown in Figure^. Consequently, there is unused capacity in the second link, 
which may be used in the next step. 

Now, for n = 2 the procedure is illustrated in Figure^. The second link does not 
change its strategy (allocation) since it is filled, i.e.: 

si 2) = (5,5,0). 

The second link sets allocations for saturated flows equal to their current trans- 
mission rates (i.e. minimal capacity allocated for these flows on their paths) and 
calculates the allocations for non-saturated flows (in this case for r = 3) to maximize 
its objective. Finally, its strategy is given by: 

sf = (5,0,95). 

In consequence, only the third source may increase its rate, resulting in rates: 

x= (5,5,95). 

Since both stopping conditions are met in the next iteration, i.e. n = 3 > L = 2 
and 7?-2 = 0, the execution ends with the following players' strategies: 

s[ H) = (5,5,0), 
s { 2 U) = (5,0,95). 

It is easy to check that these strategies constitute a Nash equilibrium. 
4.4 Pure strategy Nash equilibrium 

The existence of Nash equilibrium for the considered game can be concluded from the 
Rosen's theorem on concave L-person games (54]. It is however not obvious whether 
a given strategy is an equilibrium, or how to compute one efficiently Our main result 
is stated as the following theorem: 
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Theorem 1. Strategy S 11 constitutes a pure Nash equilibrium. 

Before we prove this theorem, we need the following lemmas. 

Lemma 1. Let f m : R + U {0} — > R, m — 1, . . . , M, be continuous, strictly increasing, 
strictly concave and twice- differentiable functions. 

For any (3 > 0, let us define a vector-valued function a* : R + U {0} — > M. M : 

{M M 

771=1 771=1 

where a — [oti, . . . , «m] t - 

Each component ct* m {(5) is nondecreasing. 

Proof. Consider the following optimization problem: 

M 

maximize / m (a m ) 

771=1 

subject to: 

M 

2j «771 = (3- 
771=1 

The Lagrange function of the problem is: 

M / M 

L(a, ii) = ^ f m {a m ) + /W /3 - a r 

771=1 \ 771=1 

Under the assumptions on functions f m , the problem is concave, thus the KKT con- 
ditions [8] imply, that the optimal solution a*, /i* satisfies: 



da* m 

dL(a*,n* s 
<9u* 

777=1 



fmiO ~ M* = 0, (7) 

M 

/?-^< = 0. (8) 



Since function / m is twice differentiable and strictly concave, thus the function 
fm( a m) < for all a m > 0. This implies that function f' m is strictly decreasing 
and continuous. Hence there exists the inverse function which is also strictly 

decreasing. 

From ([7]) the solution must satisfy: 

<c=(&rv)- (9) 

Substituting a* , for m = 1, . . . , M into (181) we obtain: 



Af 

£(&TV) = £ ( 10 ) 

771=1 

A sum of strictly decreasing functions is also strictly decreasing, thus the lefthand 
side of (10), denoted G(fi*) = Ylim=iif'm)~ l {f*) l& strictly decreasing function of //*. 



Given two values: f3\ = and /3% = G^), relation G(fi*) < G(n*£) implies that 

ji[ > For decreasing fj,*, the value of function (/^J -1 increases. From relation (|9]), 
the corresponding solution a* m increases with the increase of (3, for all m — 1, . . . , M. 

□ 
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Lemma 2. Given the strategy S 11 computed by Algorithm [7J consider all strategies 
S' 7^ S 11 , constructed as follows. For any fixed player I, let: 

S lr — S lr I e lri 

where each t\ r is any real number. Other players ' strategies fulfill: S'_ l = S_ z . 

For any such strategy s' t , if there exists r ^ TZi, such that e/ r > ; then there exists 
a strategy s" , such that: 

V r ^ tlr < 0, 

giving exactly the same payoff. 

Proof. We give a constructive proof. Let us denote the set of indices of saturated flows 
r ^ TZi such that e/ r < by TZ\ and the set of remaining saturated flows (i.e. for which 
€i r > 0) as TZj 1 . Let us consider the strategy S" constructed as follows: s" r = s' lr for 
all r G TZi U TZj and s" r = sf/ for all r ^ IZi. Such a strategy does not increase any 
allocation for the saturated flow. 

Since the strategy is feasible, it is easy to see that the new strategy s" satisfies 
the constraint A;s" < q. 

The value of player /'s payoff for strategy s' ; is: 

QM,&Ji) = 

= ai r b r u r (mm{s' lr} min s^}) + ai r b r u r (min{s' lr , min s^}) 



r 



eft" 



7/ N 



= 7 az r 6 r M r (min{s" r , min s^}) + / ai r b r u r (s lr , 
The second equality follows from the fact that: 

S'lr = S lr + e lr > 4' = m , in 4l > 

which, in turn, follows from the assumption on accordance of numbering iterations 
and links removed from consideration. Consequently, the payoff from strategy s" is 
equal to the payoff from strategy s^. 

□ 

Lemma [2] immediately implies that all strategies deviating from S 11 and giving 
better payoffs for player / should not have allocated more capacity for flows saturated 
before Ith iteration, than in the strategy S 11 . Otherwise, the difference in allocated 
capacity is wasted; the superfluous fraction of capacity may be used for allocation of 
the remaining flows in subsequent iterations. 

Corollary 1. For any I G {1, . . . , L}, if there is no strategy s\ such that V r ^^ ; e; r < 0, 
for which: 

QK^s^qks"), (11) 



then there is no other strategy s[ satisfying (11). 



14 



Lemma 3. Let S' be a strategy constructed as follows. For any fixed player I, let: 



where: 



i ii , 

S lr — S lr e lri 



V r ^ ; Sir < 0, 



and the remaining ei r are arbitrary real numbers. Other players ' strategies fulfill: S'_ t = 

If there exists r G TZi such that e r i < 0, then there exists a strategy s" , such that 
^ren €rl — ®> 9^ n 9 710 lower payoff. 

Proof. The following sequence of inequalities hold: 

max ai r b r u r (si r ) > } ai r b r u r (s^) (12) 

> 22 ai r b r u r (mm{s' lr , s"}) = Qi(s' h Si J j) - ^ ai r b r u r (s' lr ) . 

Let: 

s ; = argmax N ai r b r u r (si r ), (13) 
ren t 

D ' 1 = ) Sl '■ airSlr - Cl ~^2 airS lr' V r < Sl r ,\/ r ^ Si r = 

s" = arg max ) ai r b r u r (si r ), (14) 

D " = I Sl '■ ^2 airSlr - Cl ~^2 airS 'lr> ^riU^lr = s' lr , S [r > 

It is clear that S; = sj 1 (compare with step 11 of Algorithm KM) . 



From the assumption on e\ r for r ^ TZi, it holds that: 

CI-J2 airS ' lr = Q ~ air ( S lr + 6 lr) 

= Ci - 2J Ctlrsjr - ^2 aweir 

> Q - ^ airs\r- (15) 

rfki 

Consider feasible solutions sets D[ and D" projected on a linear subspace restricted 
only to the coordinates r G TZi (values of all other coordinates of vectors S; are fixed, 
although may be different in sets D\ and D"). Let us put 0i — Ci — a ir s 'i r an d 

da, a irs\r ■ Observe that the optimal solutions in both cases must fulfill the 
constraints with equality, as the objective functions are strictly increasing. Since both 



objective functions (14) and (13) on the restricted coordinates are identical, and from 
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(15) it holds that f3± > (3 2 , thus from Lemma [Tj the corresponding optimal solutions 
must satisfy: 



y r£Tli S lr ^ S lr 



which implies: 

□ 



V_~. e, r = s'L - si! > 0. 



Combining Corollary [T] and Lemma [3] the following can be concluded: 

Corollary 2. For any I G {1, . . . , L}, i/ i/iere zs no strategy s\ such that V r ^^ ej r < 
and V rg7 ^ ; e^ r > ; /or which: 

Qifos'JdZQiP"), (16) 



i/ien t/iere no o£/ier strategy s[ satisfying (16). 

Lemma 4. Consider any link I G {1, . . . , L} and too flows, one that is saturated in 
Ith iteration (denoted r = 1), and one that is not saturated in Ith iteration (denoted 
r = 2). Denote: 

[ s *w s *2if = ar S , ma * (ui(xi) + u 2 (x 2 )) , 
[x!,x 2 ] T eD 

where D = {[xi,a;2] T : X\ + x 2 < c}. Consider any allocation satisfying su < s\ t and 
s 2 i > s 2 i- Let 5 > 0. Then: 

< M4) + M4i)) - - 5) + W2(4 + <*)) 

< (Wl(sii) + «2(s2i)) - - 5) - ^2(^2/ + 5)) • (17) 



Proof. The first inequality in the claim (17) is valid, since [si^s^j] 7 is the maximal 
solution. The second inequality follows from the concavity of functions u\ and u 2 : 

ui(sy) + Ui(s* u -5) < ui(su) + ui(su - 5), (18) 

M2(S 2 « + 5) + M 2 (S2«) < U 2 (s* 2l + 5) + U 2 (s* 2l ). (19) 



Summing (18) and (19) side by side, and reordering the terms we obtain the claimed 
inequality (17). □ 

This lemma states that transferring a fraction 5 > of capacity from a saturated 
flow to a non-saturated one gives a degradation in the value of utility of the selected 
pair of flows. Moreover, if the allocations deviate from the optimal one (for this pair 
of flows) in a way that the saturated flow has less capacity, then this degradation is 
even higher that the one corresponding to the optimal allocation. 

The main result of this Section can be now proven. 

Proof of Theorem [7} Let us consider the following transformation of strategy S into 
S. Chose any 8 > 0, select any link / G {1, . . . , L}, select any flow r ^ TZi, subtract: 
s r i ^— s r i — 5, select any flow q ETZi, and add s q i <— s ql + S. 

From Corollary [2] it is enough to restrict the considerations only to such strategies 
S', where s' lr = sf/ + e ir , with V r ^e fr < and V r6 ^ j e ir > 0. 

It is easy to see that any such strategy S' can be produced from the strategy S 7/ 
using a finite number of described transformations: only flows r G TZi may get higher 
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allocations (adding 5), and only r ^ TZi may get lower allocations (subtracting S). The 
amount of added and subtracted capacity must be preserved. Let us denote a strategy 
obtained after applying k such transformations by S n ^ k \ 

Therefore, it is enough to show that such transformations satisfy the assumptions 
of Lemma |4j Consider a flow that gets saturated in nth iteration. Its allocations on 
link I throughout the subsequent iterations of Algorithm[T]form the following sequence: 

< _(2) < < Jn) _ (n+1) _ _ // 

°rl ^ ° r l ^ • • • _i ° r l — * r j — ... — b rl . 

This follows from the fact that as subsets of flows passing through link I get satu- 
rated, in the subsequent iterations the amount of capacity to distribute among the 
remaining non-saturated flows form a nondecreasing sequence. From the Lemma [TJ 
the allocations of a particular non-saturated rth flow are nondecreasing. 

Consider a pair of flows, r\ ^ TZi and r 2 G TZi, after applying k transformations. 
Let n be the iteration in which the flow r\ gets saturated. Thus its allocation on link 
/ > n satisfy: 

*S> nun = = (20) 

k:a k i=l 

On the other hand, the allocation on the same link I > n of flow r 2 satisfy: 

,(«) < ,(0 _ Ji < "( fc ) (2D 

S r 2 l — S r 2 l ~ S r 2 l — S r 2 l " \ ZL > 

However, the allocations [s^j, s^]] T are the optimal values obtained in the step 11 of 
Algorithm [T] Observe that these values are also the optimal solution of the problem 
of maximizing u ri (xi) + u r2 (x2), with respect to Xi,X2 > 0, subject to: X\ + X2 < 

E(n) 
r<£{ri,r 2 } a rl S rl ' 

Notice that this optimization problem is equivalent to the one for a pair of flows 
from the Lemma 4, while the allocation [s 1 /^, s^l^Y deviates from the optimal in the 
same way as the one in Lemma|4](see relations (20) and (21 )). Thus any transformation 
between strategies S 7/ and S' cannot improve the value of u n {s' ril )+u r2 (sLj). From the 
additivity of objective function jl]), the total utility Ylf=i a irk> r u T {s' rl ) cannot increase, 
and consequently, the payoff Y2 r =i a Zr^rW r (minfc :afc;=1 s' kl ) cannot increase. 

The above result can be even strengthened, taking a closer look at the construction 
of strategy S 11 . In particular, we show that the obtained strategy is strongly Pareto- 
optimal (Pareto-efficient). 

Definition 1 (Pareto optimality). Strategy S is Pareto-optimal if there is no strategy 
S' ^ S such that V, Qi(S') > Qi(S). 

Definition 2 (strong Pareto optimality). Strategy S is Pareto-optimal if there is no 
strategy S' 7^ S such that V; Qi(S') > Qi(S) and there exists such k that Qfc(S') > 

Qfc(S). 

Let us observe the following fact: 
Proposition 2. Strategy S 11 is Pareto-optimal. 

Proof. It is enough to consider only link 1 = 1. Since the allocation s[ J = s{, and 
this is the optimal solution of the problem ([6]), no strategy can give higher payoff. We 
conclude that there is no strategy S' 7^ S 1 such that for all I simultaneously higher 
payoff can be achieved. □ 
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In order to prove the strong Pareto-optimality, it is enough to show that for no link 
a strictly higher payoff can be obtained, without decreasing the payoff of any link. 



Theorem 2. Strategy S is strongly Pareto- optimal. 

Proof. The proof is by induction with respect to the increasing sequence of link subsets 
A\ D A 2 D . . . D Al. Initially, consider a single link, A\ = {1}, and similarly, as in 
the proof of Proposition [2J observe that the allocation s{ 7 cannot be changed, as it is 
the optimal solution of the problem ([6]). 

Let I > 2. Suppose all flows in the set Ai_\ cannot have their allocations changed 
in a way to improve the payoff. Now consider the subset of links A\ = Ai_i U {/}. 
Flows in link I can be divided into two disjoint subsets: TZi (the flows which allocation 
is about to be set in Ith iteration, or later) and IZi \ IZi (the flows which allocation is 
already fixed in ith iteration). As the latter flows are saturated, the increase of their 
allocations is useless as this cannot contribute to the increase of ith link's payoff (due 
to the transmission rate limit imposed by bottleneck link in However, if we 

decrease any of these allocations the payoff of some link in Ai_i will have to decrease, 
which contradicts the inductive assumption. The remaining capacity is allocated in 
/th iteration among the flows in IZi in a way that gives the highest payoff for link I (as 
in the step 11 of Algorithm [l]) . Any deviation from the strategy S 11 of the allocation 



of flows in IZi would give equal or lower payoffs. Consequently, the allocation S 7/ has 
the property that any change to this strategy cannot improve any links' payoff without 
causing a loss of at least one of the remaining players' payoffs. □ 



5 Properties of the game 

In this section we depart from the initial problem of determining Nash equilibria in the 
formulated game, and consider a reversed problem of game design: given an optimal 
solution of the NUM problem, does it constitute a Nash equilibrium of some game 
variant? 

Theorem 3. For the uniform payoff matrix (V r b r — 1) the global optimum of problem 
(jl])-(|3| is a Nash equilibrium. 

Proof. The proof is by contradiction. All players play the strategy S, such that 
V r Vz; air= i si r = x r , where x* is the global solution of the problem ([T|-([3]). Consider a 
player I G {1,. . . ,L}. Obviously, increasing allocations si r of flows sharing multiple 
links does not improve the payoff of player I. Consider flows traversing only link I, 
denoted 7Zi = {r : a ri = 1, J2k=i a rk — !}• We call such flows local. 

Links with Ri ^ must be completely filled (as otherwise increasing any local flow 
gives higher payoff). Thus in order to increase the allocation of such flow, at least 
one non-local flow's allocation must be decreased. But on the other hand, if non-local 
flows yield some capacity for local flows, then from Lemma [T] the allocations of all 
local flows must increase. 

Let us denote TZ[ = IZi \ TZi- Let e r > and i] r > be taken so as to satisfy: 
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Suppose such change in Ith player's strategy would improve its payoff: 

^ u r (x* r - e r ) + ^2 u r (x* r + rj r ) > ^2 u r (x* r ). (23) 

r£7^ r£Ri rElZi 



The value of global objective can be expressed by adding to the both sides of (23) the 
utilities of all flows that do not pass through Zth link: 

2J u r (x* r - e r ) + 2J u r (x* r + i] r ) + 2J M r(£*) 
re7e; re^j re{i,...,-R}\^i 

> u r (x*) = max u r (x r ). (24) 

r£^ ; X ' X_C r6{l,...,_R} 

The last expression is the global optimum of ([T|-(|3]). From (22): 

+T] r ) + ^(X* - 6 r ) = ^ X *r< c h 



which shows that the lefthand side of (24) is a value of feasible solution. Hence the 
inequality in (24) gives a contradiction. □ 

This immediately implies that the strategy giving optimal solution is also the best 
possible equilibrium: 

Corollary 3. For the uniform payoff matrix the Price of Stability is 1. 

The local flows, as introduced in the above proof, play a key role in the attainability 
of equilibria. Unfortunately, the uniform payoffs only upper-bound the social welfare. 
The following example shows that the variant of the game with weights reflecting the 
social welfare has an optimal solution which occurs at a non-equilibrium point. 

Example 3. Consider the game with weights b r = 1/X]fe=i a ^' wr th 10 players, 
corresponding to links of equal capacity, c\ — . . . — c\q — 6. As depicted in Figure |3j 
there are two flows: one that passes through all links, with utility function Ui{x-\) = 
10 log £1, and one local, with utility function u 2 (x2) = 2 log £2- The global optimum 
is x\ = 5 and x* 2 = 1. 

The payoff of 1st player for allocations sn = 5 and s±2 = 1 is: 

u x (x\) u 2 (x* 2 ) 10. c 2. n . c 
ao + v^io — log5+ 7 logl = log5. 



However, changing strategy of player 1 to Su = 2 and s\ 2 = 4 gives a higher payoff: 
log2 + 21og4 = log2 + logl6 >log5. 



Corollary 4. For the payoff matrix given by V r b r = 1/ Ylt=i a kr the global optimum 
of problem Q-([3]) in general is not a Nash equilibrium. 

One may observe that, provided there are no local (single-link) flows, it is easy to 
characterize strategies giving pure Nash equilibria, even for a more general class of 
games (including the one considered in this paper, see Remark ITJ. 
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Figure 3: Illustration of Example 3: one flow passes through all links, one flow is local. 

Theorem 4. If there are no local flows, i.e. for all r G {1, . . . , R], Ylf=i a ir > 1; an V 
strategy such that: 

*h,h ^r:ai ir =ai 2r =l Sl ir = S[ 2r 

constitutes a pure Nash equilibrium of the considered game. 

Proof. Fix I G {1, . . . , L}. Any change of Ith player's strategy vector S; into s' t , such 
that s' lr = Si r + e, e > 0, cannot increase the payoff, unless all the players I' sharing 
the path with I also increase allocation: s' Vr = Si> r + e. Any decrease in allocation, 
s'i r = si r — £, e > 0, can only decrease the local payoff. □ 

Although the strategies characterized in Theorem [4] are points of equilibrium of 
the considered game, they can be arbitrarily bad in terms of the players' outcomes. 
Observe that a zero-allocation strategy (V/ jT . si r = 0) is a Nash equilibrium if there are 
no local flows. Consequently, in such case the Price of Anarchy is unbounded. 



6 Computational experiments 

In this section we present an experimental study based on a prototype implementation 
of Algorithm [TJ Routing matrices used in the experiments were generated randomly, 
with probability of a flow passing through a link equal to 0.5. Link capacities were in 
the range 10-100 Mbps. Utility functions were of the form Q with parameter 7 = 0.5. 

The first experiment involves a small example of 5-link network with 8 flows. For 
the game variant with weights inversely proportional to path lengths, Figure [4] shows 
how players' payoffs changed in the subsequent iterations, while Figure [5] shows the 
corresponding changes of flows' utilities. It can be seen that only 4 out of 8 flows 
get improved by Algorithm [TJ as compared to the initial solution computed by one- 
step local algorithm. Moreover, algorithm stabilizes all transmission rates after just 
3 iterations. Figure [6] compares the total utility Q obtained in this process with its 
value obtained by the considered algorithm in the game variant with uniform payoff 
matrix (all weights set to 1). The latter variant gives a slightly better solution, but 
it overestimates the social welfare, which leads to a small degradation of solution in 
case of larger networks. Additionally, both solutions are compared to the optimal 
one, computed by directly solving NUM problem ([TJ)-([3]) using interior-point method 
solver. 

In the second experiment there were 100 links and 200 flows. Figure [7] presents 
the comparison of solution value changes throughout the iterations, compared to the 
optimal solution. In the variant of weights inversely proportional to path lengths the 
algorithm stopped after 6 iterations, while for uniform weights it took 7 iterations. 
Both solutions are similar and close to the optimum (only about 5% worse). 

It should be noted that the implementation used in the presented experiments 
neglects the technical details related to the real networks. In particular, detecting 
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Figure 4: Small network: payoffs of players in subsequent iterations. 



5 ■* 



w„=6 b„=1 



w 6 =7 


b 6 =0.5 




w 3 =7 


b 3 =1 










W b =5 


b^O.5 



w,=7 b,=0.25 



n,-7 b,=0.25 w 4 =6 bj=0.33 



v/,-5 b,=0.5 



3 

iteration 



Figure 5: Small network: utilities of flow in subsequent iterations. 



the flow saturation based on the measurements of rate variability requires a careful 
treatment and considering real-time programming issues. 



7 Conclusions 

The distributed optimization algorithm presented in this paper provides a fast and 
scalable method of solving network utility maximization (NUM) problem. By consid- 
ering links (network routers) as decision-making agents, it extends the idea of solving 
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Figure 6: Small network: comparison of total utility (NUM objective) obtained from 
Algorithm [T] in two game variants. 
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Figure 7: Large network: comparison of total utility (NUM objective) obtained from 
Algorithm [T] in two game variants. 

the problem separately for each of them, by iteratively improving local solutions, based 
on the detection of minimal rate allocation along flows' paths. Considering this al- 
gorithm as a method of computing a strategy for the introduced capacity allocation 
game, we proved that it finds a strongly Pareto-optimal pure Nash equilibrium. Since 
in the considered game the links are the players, and the payoffs are the total utilities 
of all flows passing through a link, the objective of NUM coincides with the sum of 
payoffs (social welfare), if the utilities of flows are weighted inversely proportional to 
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flow path lengths. 

We also proved that in the game variant with equal weights of all flows, the con- 
sidered game has a pure Nash equilibrium at the point of optimum of NUM. Unfor- 
tunately, if there are no flows occupying single links, then it is possible to construct a 
pure Nash equilibrium resulting in arbitrarily bad solution (i.e. the Price of Anarchy 
diverges to infinity). This, however, requires coordinating all players, and in practice 
can be avoided, if all decision-making agents belong to the same network operator. 

Computational experiments show that the presented algorithm is very efficient, and 
requires very small number of allocation updates for reaching equilibrium, regardless 
of the network size and number of concurrent flows. Solutions even for very large 
randomly generated networks were within a few percent of optimal value. 
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